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(54) Improvements in or relating to 
visual display apparatus 

(57) The Invention provides head- 
coupled area-of-interest visual display 
apparatus particularly for ground-based 
craft-flight simulators. The apparatus 
provides binocular, pseudo-col limated 
vision of a display, projected onto the 
inside of a part-spherical shell which 
carries a concave retro-reflective screen 
and surrounds the pilot. The displayed 
scene covers an area of interest centred 
upon the pilof s line of view. The image 
generator used may be of the computer 
generated image, laser-scanned model 
or closed-circuit television type. For the 
pseudo-collimated display, the same 
image is projected for left and right 
eyes from points on a pilot's helmet 
above the pilot's eye positions. Line 
scan apparatus is mounted in the pilot 
cockpit. Line image transmission is by 
fibre-optic light guide ribbon and two 
such light guide ribbons are used to 
restrict impairment of the image by 
fibre fracture. Common frame scan 
apparatus is mounted on the pilot's 
helmet. Sensing means detect the 
pilot's head/helmet movement to per- 
mit voluntary scanning of a wide angle 
of simulated pilot view from the craft. 
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SPECIFICATION 

Improvements In or relating to visual display apparatus 

5 Background of the invention 5 
This invention relates to visual display apparatus, particularly for ground-based flight simulators and 
particularly for providing a display covering a wide-angle field of view. 

The apparatus is of the head-coupied area-of-interest type, wherein an image is projected upon a screen 
and is appropriately changed both according to the simulated craft position and angular orientation and 
10 according to the viewer's instantaneous line of view and is simultaneously moved on the screen to occupy 10 
the viewer's field of view. 

Apparatus of this type was described in prior patent specification Number 1 ,489,758. Such apparatus 
provided an area-of-interest display for a sole viewer which was pseudo-collimated, that is, the same image 
was projected for left and right eyes, so as to appear at infinity. 
15 The present invention is one of a group of nine inventions relating to "area of interest" displays for use in 15 
ground-based flight simulators, described in the following published specifications: 



The nine inventions ail relate to the following apparatus combination: 
A dummy cockpit with controls for a trainee pilot; 

A curved projection screen, covering the maximum extent of viewing, centred at the pilot's eyes; 
25 An optical projector, covering the instantaneous field of view, mounted on the pilot's helmet; 25 
Sensing means for determining the pilot's instantaneous head position and control means for determining 
the scene to be projected, correspondingly; and 

Flexible fibre optic ribbons extending from cockpit-mounted optical apparatus to the helmet-mounted 
projector. 

30 The nine inventions are distinguished one from another as follows: 30 

2.041 .562 claims head-coupled area-of-interest, visual display apparatus providing stereoscopic viewing 
for one viewer, comprising a part-spherical retro-reflective concave screen of area greater than a viewer's 
instantaneous field of view, a helmet, sensing means for sensing the orientation of the viewer's head and 
helmet, visual image generating means for generating an image representing a simulated scene in the 

35 direction of the viewer's instantaneous line of view according to the viewer's simulated position and 35 
orientation and under control of the said sensing means, the said image generator being adapted for 
providing a stereoscopic pair of images corresponding respectively to the viewer's left eye and right eye 
views, a laser light source, separate laser beam modulators for the left eye and right eye views, separate line 
scanners for each said view for scanning the modulated laser beams over the input ends of respective fibre 

40 optic light guides, the said fibre optic light guides having their output ends at spaced-apart positions on the 40 
viewer's helmet, and frame scanning means mounted on the said helmet for receiving light from the light 
guide outputs and projecting the light as a scanned image upon the said screen. 

2.041.563 claims head-coupled, area-of-interest, visual display apparatus providing stereoscopic viewing 
for more than one viewer comprising a part-spherical retro-reflective concave screen of area greater than a 

45 viewer's instantaneous field of view and, for each viewer, a helmet, sensing means for sensing the 45 
orientation of the respective viewer's head and helmet, visual image generating means for generating a 
simulated scene in the direction of the respective viewer's instantaneous line of view according to a common 
simulated vehicle position and orientation and under control of the respective sensing means, the said 
respective image generator being adapted for providing a stereoscopic pair of images corresponding to the 

50 respective viewer's left eye and right eye views, a laser light source, separate laser beam modulators for the 50 
left eye and right eye views, separate line scanners for each said view for scanning the modulated laser 
beams over the input ends of respective fibre optic light guides, the said fibre optic light guides having their 
output ends at spaced-apart positions on the respective viewer's helmet, and frame scanning means 
mounted on the said helmet for receiving light from the light guide outputs and projecting the light as a 

55 scanned image upon the said screen. 55 
2,043,939 claims head-coupled, area-of-interest, visual display apparatus providing pseudo-collimated 
viewing for one viewer, comprising a part-spherical concave retro-reflective screen positioned for viewing 
by the viewer, a helmet, sensing means for sensing the orientation of the viewer's head and helmet, visual 
image generating means for generating a simulated scene in the direction of the viewer's instantaneous line 

60 of view according to the viewer's simulated position and orientation and under control of the said sensing 60 
means, a laser light source, a laser beam modulator, optical means for providing identical left eye and right 
eye views, separate line scanners for each said view for scanning the modulated laser beams over the input 
ends of more than one fibre optic light guide, the said fibre optic light guides having their output ends at 
spaced-apart positions on the viewer's helmet, and frame scanning means mounted on the said helmet for 

65 receiving light from the light guide outputs and projecting the light as a scanned image upon the said screen. 65 



20 



2,041,562 
2,041,563 
2,043,939 



2,043,938 
2,043,289 
2,039,468 



2,043,290 
2,043,941 
2,043,940 



20 



2 



GB2115946 A 



2 



2,043,938 claims head-coupled area-of-interest, visual display apparatus providing pseudo-collimated 
viewing for more than one viewer, comprising a part-spherical retro-reflective screen of area greater than a 
viewer's field of view and, for each viewer, a helmet, sensing means for sensing the orientation of the 
respective viewer's head and helmet, visual Image generating means for generating an image representing a 
5 simulated scene in the direction of the respective viewer's instantaneous line of view according to a common 5 
simulated vehicle position and orientation under control of the respective sensing means, a laser light 
source, a laser beam modulator, optical means for providing identical left eye and right eye views, separate 
line scanners for each said view for scanning the modulated laser beams over the input ends of respective 
fibre optic light guides, the said fibre optic light guides having their output ends at spaced-apart positions on 
10 the respective viewer's helmet and frame scanning means mounted on the said helmet for receiving light 10 
from the light guide outputs and projecting the light as a scanned image upon the said screen. 

2.043.289 claims for apparatus providing a raster scanned image upon a screen by deflecting a light spot of 
modulated intensity to form a scanned line and deflecting successive scanned lines to form the raster 
scanned image, line scanning, frame scanning and intermediate flexible light guide means comprising a 

15 fibre optic light guide having groups of fibres thereof fanned at the input and output ends of the light guide 15 
into concave arcuate shape the fibres corresponding to individual image spot elements being arranged in 
the same relative sequence at both input and output ends, movable mirror means positioned to reflect an 
incident modulated light beam over the arcuate configuration of fibres at the input end of the light guide, 
thereby to scan one line of the raster scanned image, movable mirror means positioned at the output end of 

20 the light guide for frame scanning successive lines of the raster scanned image and lens means positioned 20 
between the output end of the light guide and the frame scanning mirror for focussing the output ends of the 
fibres onto the said screen. 

2,039,468 claims a head-coupled area-of-interest visual display system, for projecting upon a screen at 
least partly surrounding a viewer a scene generated by an image generator of the computer-generated 

25 image type and projected as a raster-scanned light-spot image by optical means mounted for movement 25 
with the head of the viewer, the characteristics of which image computer are such that, upon change of the 
viewer's head orientation from a first head orientation to a new head orientation, the changed scene 
corresponding to the new head orientation is delayed for an interval noticeable to the viewer, throughput 
delay error control means responsive to a viewer's head orientation sensor for projecting the said image 

30 substantially at the screen position corresponding to said first head orientation for a predetermined time 30 
interval not less than the said computer delay interval and at the screen position corresponding to said new 
head orientation after said time interval, the said control means controlling both the line-scanning and 
frame-scanning synchronisation of the scanning raster according to the following rules: 

i) Advancing the video signal with respect to the projected line start when the new position is the result 

35 of an angular rotation in the direction of the line scan; 35 

ii) Delaying the video signal with respect to the projected line start when the new position is the result of 
an angular rotation in the direction opposite to that of the line scan; 

iii) Advancing the video signal with respect to the projected frame start when the new position is the 
result of an angular rotation in the direction of the frame scan; 

40 iv) Delaying the video signal with respect to the projected frame start when the new position is the result 40 
of an angular rotation in the direction opposite to that of the frame scan; and 

v) Restoring the original relative time sequence of both line- and frame-scanning synchronising pulses at 
the end of said time interval. 

2.043.290 claims head-coupled, area-of-interest, visual display apparatus providing a displayed scene 

45 comprising two zones, including a part-spherical retro-reflective concave screen of area greater than a 45 
viewer's instantaneous field of view, a helmet, sensing means for sensing the orientation of the viewer's 
head and helmet, visual image generating means for generating a simulated scene in the direction of the 
viewer's instantaneous line of view according to the viewer's simulated position and orientation and under 
control of the said sensing means, the said image generator being adapted for providing two visual images 

50 corresponding respectively to the two zones of the displayed scene, a laser light source, separate laser beam 50 
modulators for each zone of the displayed scene, separate line scanners for each zone of said scene for 
scanning the modulated laser beam over the input ends of respective fibre optic light guides, the said fibre 
optic light guides having their output ends at spaced-apart positions on the viewer's helmet, and frame 
scanning means mounted on the said helmet for receiving light from the light guide outputs and projecting 

55 the light as simultaneous scan lines of the two said zones to form the composite displayed scene on the 55 
screen. 

2,043,941 claims head-coupled area-of-interest, visual display apparatus providing a displayed scene 
having two zones the first zone being of greater area and having a lower definition image relatively to the 
second zone, the second zone being of smaller area, being inset within the first zone and having a higher 

60 definition image relatively to the first zone, comprising a part-spherical retro-reflective concave screen of 60 
area greater than a viewer's instantaneous field of view, a helmet, sensing means for sensing the orientation 
of the viewer's head and helmet, visual image generating means for generating a simulated scene in the 
direction of the viewer's instantaneous line of view according to the viewer's simulated position and 
orientation and under control of the said sensing means, the said image generator being adapted for 

65 providing two visual images corresponding respectively to the two said zones of the displayed scene, a laser 65 
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light source, separate laser beam modulators for each zone of the displayed scene, separate line scanners for 
each zone of the said scene for scanning the modulated laser beam over the input ends of respective fibre 
optic light guides, the said fibre optic light guides having their output ends at spaced-apart positions on the 
viewer's helmet, and frame scanning means mounted on the said helmet for receiving light from the light 
5 guide outputs and projecting the light as simultaneous scan lines of the two said zones to form a composite 5 
two-zone displayed scene on the screen. 

2,043,940 claims for projection apparatus in which an image is projected upon a retro-reflective screen 
along a line which differs from a viewer's line of view, a screen comprising a rear retro-reflective surface of 
reflective characteristic such that the axis of the cone of a reflected beam of light is colinear with or along the 
10 line of projection of the light beam and a forward transparent screen of material having a refractive index 10 
other than unity and a grooved front or rear surface whereby the axis of the cone Is a reflected beam of light 
diverges from the line of projection of the light beam by an angle which substantially corresponds with that 
between the line of projection and the line of view. 

15 Short description of drawings 15 
In orderthat the invention may readily be carried into practice, one embodiment will now be described in 
detail, by way of example, with reference to the accompanying drawings, in which :- 

Figure 1 is a diagrammatic perspective view showing a pilot and co-pilot seated in relation to a 
part-spherical screen, with a block schematic diagram of apparatus for pseudo-collimated viewing by the 
20 two pilots; " 20 

Figure 2 is a diagrammatic representation of one laser source, laser beam modulator, line scanner, fibre 
optic light guide ribbon, and helmet-mounted frame-scanner combination used in the apparatus of Figure 1 ; 
Figure 3 is a diagrammatic side view of the frame scanner of Figure 2; 
Figure 4 is a detail view showing an alternative line scanner to that of Figure 2; and 
25 Figure 5 is a diagrammatic cross-section view in a vertical plane of part of the screen surface and 25 
diffraction grating layer of a modified retro-reflective screen used in the apparatus of Figure 1 . 

Description of the example 
In the accompanying drawings the same elements are indicated by the same reference numerals 

30 throughout. 30 
Figure 1 shows in diagrammatic form the apparatus according to the invention for generating and 
displaying individual pseudo-coliimated area-of-interest views for pilot and co-pilot. The pilot 1 0 wearing a 
helmet 12 is seated within a part-spherical shell having a retro-refractive interior surface in part represented 
in Figure 1 by the concave retro-reflective screen 14. the pilot's line of vision, for right and left eyes and 

35 distant viewing, intersects the screen at points 1 6 and 1 8, respectively. The field of view for each eye is 35 
centred on the respective one of these two points. The views displayed are identical for right eye and left eye 
but are displaced laterally by the distance between the two points 16 and 18 so that the pilot 12 sees a 
pseudo-collimated view, that is to say, the displayed view appears to be at infinity and not at the distance of 
the screen 14. The combined left eye and right eye views seen by the pilot will be referred to as the pilof s 

40 displayed view, 40 
The pilot's displayed view depends, in this example, upon the simulated position of an aircraft during an 
exercise flight, the attitude of the aircraft, the pilot's seating position in the aircraft and the pilot's 
instantaneous line of view as determined by the instantaneous orientation of the pilot's head and helmet. 
The position of points 1 6 and 1 8 on the screen 14 and hence the position of the pilot's displayed view on the 

45 screen depends only on the pilot's head and helmet orientation. 45 
The image required for the pilot is generated by an image generator 20 of the computer-generated image 
type having a frame buffer store 20'. The pilot's head orientation is sensed by a head orientation sensor 22, 
which is fixedly mounted within the simulated aircraft cockpit in a mounting 24, The pilot's displayed view is 
projected onto the screen 14, centred in the appropriate locations as two raster-scanned images, the line 

50 scan apparatus being cockpit-mounted and the frame scan apparatus being mounted on the helmet 12. Line 50 
scan may be either across the screen 14 or up or down. In the present example, line scan is such that the 
projected scan line on the screen and the line joining a pilot's two eyes lie in one plane. The frame scan is in a 
plane orthogonal to that plane. Thus, if a pilot is sitting upright, line scan is horizontal and frame scan 
vertical. 

55 The co-pilot 1 1 wearing a helmet 13 is also seated in front of the retro-reflective screen 14. The co-pilof s 55 
line of vision, for right and left eyes respectively and for distant viewing, intersect the screen 14 at points 17 
and 19. The field of view for each eye of the co-pilot Is centred on the respective one of these two points. 

The views displayed are identical for right eye and left eye but are displaced laterally by the distance 
between the two points 17 and 19, so that the co-pilot 13 also sees a pseudo-collimated view. The combined 

60 views seen by the co-pilot will be referred to as the co-pilof s displayed view. 60 
The co-pilot's displayed view depends upon the simulated position of the aircraft during the exercise 
flight, the attitude of the aircraft, the co-pilof s seating position in the aircraft and the co-pilof s instantaneous 
line ofview. The firsttwo factors will be the same as for the pilot. The co-pilof s seating position will be 
different but will not change during an exercise flight The head orientation will be independent and 

65 individual to the co-pilot and require a separate image generator. 65 
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The image required for the co-pilot is generated by an image generator 21, also of the computer-generated 
image type and having a frame buffer store 21 \ The co-pilofs head orientation is separately sensed by the 
head orientation sensor 23. The displayed view is projected onto the screen 14, in the appropriate locations 
as two raster-scanned images, the line scan apparatus being cockpit-mounted and the frame scan apparatus 
5 being mounted on the co-pilofs helmet 13. 5 
Referring still to Figure 1 , a laser source 30 provides an output laser beam 31 which is directed through a 
beam splitter and reflector combination 32, 33 to provide two beams 34 and 35 of equal intensity. Laser 
beam 34 passes through a full-colour modulator 38 controlled from the image generator 20 according to the 
pilot's view to be projected. The modulated beam 34 passes to a double line scanner 42 fixedly mounted in 
10 the simulated aircraft cockpit. The two scanners, described in detail later herein, provide two respective 10 
scanned beams 44 and 46 which are respectively scanned over the input ends 48 and 50 of two fibre optic 
light guide ribbons 52 and 54. 

The two fibre optic light guides 52, 54 provide a flexible linkage between the fixed line scanner 42 and the 
pilof s movable helmet 12. The emergent scanned light beams from the respective ends 56 and 58 of the light 
1 5 guides 52 and 54 are focussed by spherical lenses 62 and 64 onto the screen 14 and directed onto a plane 15 
mirror 60. The right eye beams are reflected by the mirror 60 along divergent paths to form a scan line the 
centre of which is shownat 66. Similarly, the left eye beams are reflected by the mirror 60 along divergent 
paths to form a scan line the centre of which is shown at 68. The centre image lines of the pilot's right eye 
and left eye presentations of the view are thereby formed on the screen 14, each line having its respective 
20 mid point at 16 and 18 and being viewed by the pilot 10 in the respective line of view 70 and 72. 20 
The mirror 60 is long in relation to its width and is carried in bearings at its end which are mounted on the 
helmet 12. These bearings are provided by motors 74and 76 at the two ends which move the mirror 60 to 
provide the required frame scan. 
The mirror 60 may be a single plane mirror which is either oscillated or rotated by the motors 74, 76 on its 
25 axis parallel to the plane in which the line scan is projected, or the mirror 60 may be a multi-faceted mirror 25 
rod of, for example, octagonal cross-section which is continuously rotated by the motors 74, 76. In the 
present example, the mirror 60 is a single plane mirror and is oscillated for frame scan. 

As the pilot's head moves, so does the displayed view move over the screen, so as to be in the pilot's new 
line of view and the view itself is changed according to the simulated real world view in the direction of the 
30 pilot's line of view. 30 
To this end, the visual system receives data from the host flight computer on lines 80 and 81 . Position data 
defining the simulated aircraft position throughout a simulated flight exercise is supplied to the image 
generator 20 on line 80. Attitude data, defining the simulated aircraft instantaneous attitude, is supplied on 
line 81 to a vector summing unit 82 together with head orientation data, defining the pilof s actual 
35 instantaneous line of view, on line 84. The summed output is supplied to the image generator 20 on line 86. A 35 
throughput delay error signal obtained by subtracting the pilof s head attitude input to the image generator 
one throughput delay period ago from the current head attitude position is supplied to the throughput delay 
error control 100 on line 119. 
The image, duplicated respectively for the pilot's right eye and left eye views, in accordance with the 
40 inputted data, and allowing for the known seating position of the pilot in the simulated aircraft type, is 40 
supplied to the modulator 38 on line 88. 

It will be appreciated that the change of the displayed image with simulated aircraft position is relatively 
slow. However, the change of the displayed image with head orientation is complete and relatively very 
rapid. The image generator is unable to compute an entirely new image immediately a new line of view for 
45 the pilot is established, due to the throughput delay of the image generator computer. To overcome this 45 
limitation the residual old displayed view is derotated to its former screen position until the computed new 
displayed view is available. 

The required image derotation is effected by controlling the relationship between the video signal and the 
line scan and frame scan positions. This control can be produced in a number of ways. 
50 The line scanner is typically a continuously rotating polygon which sweeps the input laser beam or beams 50 
through an arc to produce a line scan, as in the example of Figure 2. Three alternatives are available: 

(i) If the video signal is produced at a constant rate then the line scan drive may be phase modulated to 
maintain the correct line in space to produce an image with the correct spatial orientation. If the line 
projection system is capable of transmitting only the displayed field of view, then the image size will only be 

55 that part which is common to both the computed and projected images. This area is shown hatched in Figure 55 
2(C). If the fibre optic ribbon and the projection system is capable of projecting more than the required field 
of view in the line scan direction then the field of view obtained may be held constant. 

(ii) The video signal may be produced at a constant rate and the line scanner rotated at a constant rate. 
The required angular shift may then be introduced with a supplementary mirror. Line scanning apparatus, 

60 alternative to that of Figure 4 and including such a supplementary mirror, is described iater herein with 60 
reference to Figure 4. 

(Hi) The polygon mirror may be run at a constant angular velocity and the video signal timing adjusted by 
altering the time at which the video signal is read out of the frame store 20' of the image generator 20. This 
ensures that the video signal corresponding to a point in space is produced at the predetermined time that 
65 the scanner points the light beam at that part of the screen representing the required point in space. 65 
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Of these three methods described above, method (i) involves the phase modulation of a mechanical 
system rotating at high speed and has the disadvantages associated with the inertia and response times of 
such a system. Method (ii) overcomes some of these problems by using a supplementary mirror. This mirror 
does not rotate at high speed but nevertheless has inertia inherent in any mechanical system and so It will 
5 have some response time. Method (iii) requires only the ability to read out a memory at controlled times. 5 
Since a memory is not a mechanical system, it has no inertia and can be read out in a discontinuous manner 
if required. Accordingly, method (iii) is the preferred method for line scan synchronisation in the present 
invention. 

The frame scanner of Figure 1 does not offer the same options as does the line scanner due to the 
10 difficulties of implementation. The alternative methods corresponding to those described forthe line 10 
scanner are as follows: 

(i) If the video signal is produced at a constant rate then the frame scan drive may be controlled to give 
the required pointing direction. In this case the frame scanner will be a position servomechanism driven by a 
sawtooth wave form in which the starting point of the ramp may vary in a controlled manner and the slope of 

15 the ramp may vary in a controlled manner in order to give a constant angular sweep in free space when the 15 
projector mount is being subjected to angular shifts. 

(ii) The use of a supplementary mirror is impractical in the frame scanner of Figure 1 . 

(iii) If the frame scanner is driven with a sawtooth of constant period, start point and slope, then the read 
out times from the frame store 20' may be adjusted to produce the video signal when the scanner is at the 

20 required orientation in free space. 20 
Of these three methods, method (i) requires adjustments to the period and rate of a mechanical system 
which, due to its construction, has a very low inertia. Hence, the settling time following such a disturbance 
may be acceptable. It can preserve the instantaneous field of view constant through the througput delay 
period. Method (ii) is impractical due to the physical constraints of the projection line and frame scanner 

25 assembly of Figure 1. Method (iii) involves adjustment to a system without inertia orthe requirements of 25 
continuity. However, method (iii) reduces the virtual field of view during the throughput delay period. 

Continuing with the description of the apparatus of Figure 1, a synchronising pulse generator 106 supplies 
pulseson line 108tothethroughputdelay errorcontrol unit 100. 
Line scan control signals are supplied to the line scanners of unit 42 from unit 92 by way of line 94. Frame 

30 scan control signals are supplied to the frame scan motors 74, 76 from unit 96 by way of a flexible line 98. 30 
Video synchronisation timing pulses are fed to the frame buffer 20' of the C.G.I, image generator 20, from the 
unit 1 00 on line 1 1 0. Control of the relative timings between the line scan control 92, the frame scan control 
96 and the C.G.I, image generator frame buffer 20' is effected by the throughput delay errorcontrol unit 100 
byway of lines 102, 104 and 110, respectively. 

35 It will be noted that the projection middle lines 66 and 68 do not coincide with the lines of view 70 and 72 35 
forthe reason that projection is effected from above the pilot's eyes. Projected onto any horizontal plane, the 
respective lines are coincident but, projected onto any vertical plane, the respective lines diverge away from 
the screen. The angle of divergence is small but is nevertheless great enough, compared with the apex angle 
of the half-brilliance cone of reflection of a retro-reflective screen material to result in a viewed scene of 

40 much reduced brilliance. It is preferred therefore to use a screen of modified retro-reflective material for 40 
which the axis of the half-brilliance cone of reflection is depressed downwardly by the angle between the 
projection lines 66, 68 and the line of view lines 70, 72. 

An independent view for the co-pilot is provided in similar manner. Laser beam 35 passes through a 
full-colour modulator 39 controlled from the image generator 21 according to the co-pilot's view. The 

45 modulated beam 35 passes to a double line scanner 43 fixedly mounted in the simulated aircraft cockpit. The 45 
two scanners provide two respective scanned beams 45 and 47 which are respectively scanned over the 
input ends 49 and 51 of two fibre optic light guide ribbons 53 and 55. 

The two fibre optic light guides 53, 55 provide a flexible linkage between the fixed line scanner 43 and the 
co-pilot's movable helmet 13. The emergent scanned light beams from the respective ends 57 and 59 of the 

50 light guides 53 and 55 are focussed by spherical lenses 63 and 65 onto the screen 14 and directed onto a 50 
plane mirror 61 . The co-pilot's right eye beams are reflected by the mirror 61 along divergent paths to form a 
scan line the centre of which is shown at 67. Similarly, the co-pilot's left eye beams are reflected by the 
mirror 61 along divergent paths to form a scan line the centre of which is shown at 69. The centre image lines 
of the co-pilot's right eye and left eye presentations of the view are thereby formed on the screen 14, each 

55 line having its respective mid point at 17 and 19 and being viewed by the co-pilot 1 1 in the respective line of 55 
view 71 and 73. 

The mirror 61 is carried in bearings at its ends which are mounted on the helmet 13. These bearings are 
provided by motors 75 and 77 at the two ends which move the mirror 61 to provide the required frame scan. 
In the present example, the mirror 61 is a single plane mirror and is oscillated for frame scan. 
60 As the co-pilot's head moves, so does the co-pilof s displayed view move over the screen, so as to be in the 60 
co-pilof s new line of view and the view itself is changed according to the simulated real world view in the 
direction of the co-pllot's line of view. 

To this end, the visual system receives data from the host flight computer on lines 80 and 81 . Position data 
defining the simulated aircraft position throughout a simulated flight exercise is supplied to the image 
65 generator 21 on line 80. Attitude data, defining the simulated aircraft instantaneous attitude, Is supplied on 65 
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line 81 to a vector summing unit 83 together with head orientation data, defining the co-pilot's actual 
instantaneous line of view, on line 85. The summed output is supplied to the image generator 21 on line 87. A 
throughput delay error signal for the co-pilof s view is similarly obtained by subtracting the co-pi!of s head 
attitude input to the image generator 21 one throughput delay period ago from the current head attitude 
5 position and is supplied to the throughput delay error control 101 on line 120. 5 
^ The image duplicated respectively for the co-pilot's right eye and left eye views, In accordance with the 
inputted data, and allowing for the known seating position of the co-pilot in the simulated aircraft type, is 
supplied to the modulator 39 on line 89. 
Line scan control signals are supplied to the line scanners of unit 43 from unit 93 by way of line 95. Frame 

10 scan control signals are supplied to the frame scan motors 75, 77 from unit 97 byway of a flexible line 99. 10 
Video synchronisation timing pulses are fed to the frame buffer store 21' of the C.G.I. Image generator 21 on 
line 111. Control of the relative timing between the line scan control 93, the frame scan control 97 and the 
C.G.I, image generator frame buffer store 21' is effected by the throughput delay error control unit 101 by 
way of lines 103, 105 and 1 1 1 r respectively. 

15 The co-pilot is seated at the same distance from the screen 14 as is the pilot and the frame scan mirror 61 is 15 
the same distance above the co-pilot's eyes as the frame scan mirror 60 is above the pilot's eyes. The angle 
between the projection line and the line of view is thus the same for pilot and co-pilot. The same modification 
of retro-reflection angle of the screen 14 is therefore equally effective for both pilot and co-pilot 
The various units of the apparatus, shown in the block schematic part of Figure 1, will now be considered 

20 in further detail in the following order: 

C.G.I. Image Generator. 

Laser Source. 

Laser Beam Modulator. 
25 Line Scanner. 

Fibre Optic Light Guide Ribbon. 

Frame Scanner. 

Retro-reflective Screen. 

Helmet-Head Orientation Sensor. 
30 Throughput Delay Error Compensation unit. 

Line Scan Control. 
' Frame Scan Control. 

C.GJ. image Generator 

35 The displayed view corresponds to a real world view as it would be visible from the simulated aircraft 35 
during flight. In earlier visual display apparatus for ground-based simulators, the visual image was 
generated using a scale model and a closed-circuit television camera. The camera lens, comprising an 
optical probe, was moved over the model correspondingly to the aircraft simulated position, altitude, 
heading, pitch and roll. The generated image was varied according to all these factors. 

40 According to a more recent technique, now well established, the same form of image is computer- 40 
generated. The technique is explained in text books such as, for example, "Principles of Interactive 
Computer Graphics", by William M. Newman and Robert F. Sproull, published in 1973 by McGraw-Hill Book 
Company, New York and elsewhere. 
The signals available to the image generator computer from the host flight computer of the simulator are: 

45 aircraft position, X.Y., altitude, heading, pitch and roll. C.G.I. image generators are known which generate the 45 
direct ahead view from the aircraft according to the input data, including solid-looking features with surface . 
detail, concealing hidden edge-lines and surfaces as the aircraft flies around such objects and clipping and 
windowing the display according to the simulated field of view. 
The image generator 20 of Figure 1 is of this general type. Aircraft position and attitude data are supplied 

50 from the host flight computer on line 80. Aircraft heading, pitch and roll data are supplied on line 81. 50 
However, the image generated in the apparatus of Figure 1 is in the actual instantaneous line of view of the 
pilot This view is determined also by the pilot's line of view heading and pitch and head roll relatively to the 
aircraft axes. Head azimuth, head pitch and head roll are determined by the head orientation sensor 22 and 
these data are supplied on line 84 to the summing unit 82, which adds these values to the aircraft heading, 

55 pitch and roll values respectively. The output information defining the pilot's line of view relatively to the 55 
simulated terrain overflown is supplied to the image generator 20 on line 86. 

The point midway between the pilot's eyes is a constant position offset above and to the left of the aircraft 
longitudinal axis. This offset requires only constant values to be added to aircraft altitude and position 
respectively throughout an entire exercise. 

60 It will be appreciated that, at cruising altitudes the offsets for left and right eyes, and for pilot's seating 60 
position in the aircraft are of small importance. However, for runway, near-ground and near-target 
manoeuvres, they are of great importance. 

For the generation of separate pilot and co-pilot views, two similar type image generators 20 and 21 are 
used. The second view generated by the image generator 21 is In the instantaneous line of view of the 

65 co-pilot This view is determined by the co-pilof s line of view heading and pitch and head roll relatively to 65 
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the aircraft axes. Co-pilot head azimuth, head pitch and head roll are determined by the head orientation 
sensor 22 and these data are supplied on line 85 to the summing unit 83, which adds these values to the 
aircraft heading, pitch and roll values, respectively, on line 81. The output information defining the co-pilot's 
line of view relatively to the terrain is supplied to the image generator 21 on line 87. 
5 The point midway between the co-pilot's eyes is a constant position offset above and to the right of the 5 
aircraft longitudinal axis. This offset similarly requires only constant values to be added to aircraft altitude 
and position respectively. 

Pilot video signals are transmitted to modulator 38 on line 88. Co-pilot video signals are transmitted to 
modulator 39 on line 89. 

10 10 
Laser Source, Laser Beam Modulator, Line Scanner, Fibre Optic Light Guide Ribbon and Frame Scanner 

One laser source, laser beam modulator, line scanner, fibre optic light guide ribbon and frame scanner 
elements of the apparatus will be described together with reference to Figure 2 and Rgure 3. 

Figure 3 shows the laser beam source 30 which provides the output laser beam 31 directed through the full 
15 colour modulator 38. Both the laser beam source 30 and the modulator 38 are of known form. The full-colour 15 
modulated beam output is shown at 31 ' in this figure, in which intermediate beam-splitters are not shown. 
The line scanner is shown generally at 42. 

The line scanner comprises a synchronously-driven polygonal section mirror drum 144 whichh rotates 
continuously in the direction shown by the arrow 145 to sweep the beam 31 ' over the scan path 44. One pass 
20 occurs for the movement of each mirror facet of the mirror drum 144 past the beam 3V. 2 0 

Afibre optic light guide, formed into a flat ribbon 52 over most of its length, has individual groups of fibres 
formed into an arc at the input end 48 of the light guide. The width of the line scan 44 exactly covers the arc at 
48, so that the modulated beam 31' is scanned along the arc at 48 for each line of the image. 

At the output end 56 of the fibre optic light guide 52, the individual groups of fibres are similarly formed 
25 into an arc the fibre groups occurring in the same sequence at the two ends 48 and 56, so that the scanned 2 5 
image line at the input end 48 is exactly reproduced at the output end 56. 

The emergent rays from the output end 56 of the line guide 52 are focussed by the spherical lens 62 onto 
the face of the frame scanning mirror 60. As shown in Figure 1, the mirror 60 is mounted on the pilot's helmet 
12 in bearings provided by reciprocating motors 74 and 76. 
30 With the mirror 60 stationary, the emergent rays are reflected from the mirror 60, as shown 30 
instantaneously at 66, to form a single line of the image. As the mirror 60 is moved, successive lines of the 
image are projected to form the entire scanned image. 

Figure 3 shows, in side view, the output end 56 of thelight guide 52, the spherical lens 62, the mirror 60 
and the reflected beam 66 as described above with reference to Figure 2. 
35 A second line scanner, comprising a second mirror drum, produces a second fine scan over the input end 35 
50 of the second fibre optic light guide 54, as is shown in Figure 1 . The output end 58 of this second light 
guide 54 provides emergent rays which are focussed by a second spherical lens 64 onto the same 
reciprocating mirror 60. The two helmet mounted optical systems, with the common frame scan mirror 60, 
together provide the right eye image and left eye image of the pilot 1 s displayed view. 
40 As already explained, the identical right eye and left eye images provide the pseudo collimated display for 40 
the pilot. 

An exactly duplicate arrangement mounted on the co-pilot's helmet 13 provides the corresponding visual 
display for the co-pilot 

Figure 4 shows line scanning apparatus alternative to that of Figure 2 and including a supplementary 
45 mirror 202, The mirror 202 is pivotable on an axis 203 which is parallel to the spin axis 204 of the polygon 45 
mirror line scanner 144. 

To effect image derotation for head movement in the direction of line scan by the alternative method, the 
mirror 202 is rotationally positioned about its axis 203 by a motor 205 in a controlled manner so that the 
swept arc 44 is positioned at the required part of the arc 48 at the input end of the fibre optic light guide 52. 
50 The motor 205 is controlled from the throughput delay error control unit 100 by a signal on line 102. 50 

Modified Retro-Reflective Screen 

Retro-reflective projection screen material such as that sold under the name SCOTCHLITE {Registered 
Trade Mark) has a reflection characteristic such that light incident upon the screen is mostly reflected back 

55 along the line of incidence. That is to say, reflected light is brightest on the line of incidence, falling in 55 
intensity rapidly as the eye is displaced from the line of incidence in any direction. With one retro-reflective 
material, observed brightness falls to one-half intensity at an angle of 0.8° displacement from the line of 
incidence. Stated in other words, the area of half-brightness is the surface of a cone having its axis on the line 
of incidence and having a half-angle of 0.8° at its apex. 

60 in the projection apparatus described with reference to Figure 1, the line of incidence 66, between the 60 
frame scanner 60 and the screen 14, makes an angle which is also approximately 0.8° with the line of view 70, 
between the screen 14 and the eye of pilot 10. Thus, with an unmodified retro-reflective screen, the projected 
image would be seen at half-brightness by the pilot 
In the apparatus of the invention, it is preferred to modify the reflection characteristic of the screen in order 

65 to increase the brightness of the projected image on the pilot's line of view. This modification is effected by 65 
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placing a diffraction grating in front of the screen surface. Figure 4 shows one suitable construction. 

In Figure 4, which is a section view in the vertical plane including both the line of incidence 66 and the line 
of view 70, the surface of the retro-reflective screen is shown at 14. Placed in front of the screen 14 is a 
diffracting layer 140 of material having a refractive index of 1.5. 
5 The layer 140 is separated from the screen 14 by a layer of air 142. Neither the depth of the layer of air 142 5 
northatof the refracting layer 140iscritical but both maybe of the order of 10 to 100 mm. 

The front face of the refracting layer 140 is formed into a diffraction grating of horizontal grooves 144, 
leaving horizontal lands 146. The width of the grooves 144 and lands 146 is approximately equal. Calculated 
for light of 550 nm., and a refractive index of 1.5, the depth of the grooves 144 is 0.3 mm., and the spacing of 
10 the grooves is 36 mm., in the vertical direction, as shown in the drawing. 10 

The modified reflection characteristic of the composite retro-reflective surface and diffraction layer, in the 
plane of the drawing, is that the light reflection along the line of incidence is reduced to a value of about 90% 
of that for the unmodified screen. The 10% of light not reflected along the line of incidence is distributed at 
angles above and below the line of incidence corresponding to first- and higher-diffracted orders. Of these, 
1 5 the brightest are the two at the angle of 0.8° above and below the line of incidence. That one which is 0.8° 1 5 
below the line of incidence is along the line of view. By this means, the projected image brightness along the 
line of view is significantly increased. 

In an alternative construction of the diffraction grating, not illustrated in the drawings, the front face of the 
refracting layer 140 is serrated in cross section, so that a greater proportion of the diffracted light is directed 
20 downwardly to the pilot's and co-pilofs eyes. 20 

Head/Helmet Orientation Sensor 

Mechanical linkages have been proposed to sense the orientation of a pilot's helmet relatively to an 
aircraft cockpit However, mechanical arrangements of any sort are undesirable in the environment of an 

25 aircraft simulator cockpit 

It is preferred to effect helmet orientation sensing by non-contact means. Any suitable known head/helmet 
orientation sensor may be used in apparatus of the present invention to provide electrical signals defining 
instantaneous helmet orientation. One such sensor is that described by R.G. Stoutmeyer and others in U S 
patent No. 3,917,412, entitled "Advanced Helmet Tracker Using Lateral Photodetection and Light-Emitting " 

30 Diodes . Such apparatus is further described by Edgar B. Lewis in U.S. patent No. 4,028,725, entitled 
"High-Resolution Vision System". 

Throughput Delay Error Compensation Unit, Line Scan Control and Frame Scan Control 
As has been explained earlier in the description, the C.G.I, image generator 20 takes an appreciable time to 
35 compute a new viewfor display when the pilot's line of view is changed. The delay is of the order of 100 m 35 
sees. However, when any viewer changes his line of view, by extensive head movement, there is a delay 
before the viewer appreciates the new view before him. This delay also is of the same order of time as the 
image generator delay. 

In a simplified form of the apparatus according to the invention means are provided merely to ensure that 
40 the old display is not projected in the new line of view of the changed head position. 40 
In this simplified form of the apparatus, a large change of head orientation signal on line 1 19 or on line 120, 
respectively. Is effective to blank out the corresponding projected view for a period of some 100 m sees, until 
the new view has been computed, for the pilot or co-pilot, respectively. 
The apparatus of Figure 1 provides means for the derotation of the pilof s projected image upon rotation of 
45 the pilof s head and similarly for the derotation of the co-pilot's projected image upon rotation of the 45 
co-pilot's head. Derotation is considered to be of especial importance when head movement is such that the 
new field of view is not separate from the old field of view but is within it or overlaps it. 

The displayed view is some 100° in azimuth and some 70° In elevation, with respect to the pilof s or 
co-pilof s respective line of view. Although a viewer's field of view may exceed these angles, the marginal 
50 areas are low-interest and the central area of prime-interest may be a cone of perhaps only 5° about the line 50 
of vision. It is therefore readily possible for the pilot to change his line of view so as to move this area of 
central interest within the initial displayed view area. 

In the apparatus of Figure 1, line scan is generally across the screen 14 and frame scan is orthogonal 
thereto. The head orientation sensors 22 and 23 provide signals resolved into head azimuth movement and 
55 head pitch movement, for the pilot and co-pilot, on lines 84 and 85 respectively. 55 
The synchronising pulse generator 106 provides a line synchronising and frame synchronising pulse 
output of equally spaced apart pulses. Upon change of head azimuth, the output signal on line 119 causes 
unit 100 to provide a relative change of phase of the line synchronising pulses supplied by control unit 92 to 
the line scanner 42, and the video synchronising pulses supplied by the throughput delay error control unit 
60 100 to a frame buffer 20' of image generator 20 on line 110, in the sense to displace the displayed image 60 
equally and oppositely to every change of azimuth. 

Similarly, the output signal on line 1 19 causes control unit 100 together with frame scan control unit 96 to 
provide a relative change of phase of the frame synchronising pulses supplied by control unit 96 to the frame 
scanning motors 74 and 76. 

65 Thereby, upon piiot head rotation in azimuth or pitch or both, the corresponding displayed view is 65 
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displaced oppositely. The denotation Is maintained for a period of some 100 m sees., until the new view is 
computed. The original relative timing of the synchronising pulses Is then restored, so that the new view is 
displayed in the direction of the new line of view. 
Similarly, for derotation of the co-pilot's projected Image, upon change of co-pilof s head azimuth, the 
5 output signal from summing unit 83 on line 120 causes the throughput delay error control unit 101 to provide 5 
a relative change of phase of the line synchronising pulses supplied by control unit 93 to the line scanner 43, 
and the video synchronising pulses supplied by the control unit 101 to the frame buffer store 21 ' on line 1 1 1 
are In the sense to displace the co-pilot's displayed image equally and oppositely to every change of 
co-pilot's head azimuth. 

10 Similarly, the output signal on line 120 causes control unit 101 together with frame scan control unit 97 to 10 
provide a change of phase of the frame synchronising pulses supplied by control unit 97 to the frame 
scanning motors 75 and 77. 
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1 . Head-coupled, area-of-interest, visual display apparatus providing pseudo-collimated viewing for one 
viewer, comprising a part-spherical concave retro-reflective screen positioned for viewing by the viewer, a 
helmet, sensing means for sensing the orientation of the viewer's head and helmet, visual image generating 
means for generating a simulated scene in the direction of the viewer's instantaneous line of view according 

20 to the viewer's simulated position and orientation and under control of the said sensing means, a laser light 20 
source, a laser beam modulator, optical means for providing identical left eye and right eye views, separate 
line scanners for each said view for scanning the modulated laser beams over the input ends of more than 
one fibre optic light guide, the said fibre optic light guides having their output ends at spaced-apart positions 
on the viewer's helmet, and frame scanning means mounted on the said helmet for receiving light from the 

25 light guide outputs and projecting the light as a scanned image upon the said screen. 25 

2. Head-coupled, area-of-interest, visual display apparatus as claimed in Claim 1 , in which the visual 
image generating means is of the computer-generated image type and simultaneously computes 
corresponding left-eye and right-eye images and provides corresponding video modulation signals for the 
said left-eye and right-eye laser beam modulators. 

30 3. Head-coupled, area-of-interest, visual display apparatus as claimed in Claim 2, for a ground-based 30 
craft flight simulator, in which the computer-generated image generating means is provided with input 
signals from a craft flight computer defining craft position and is also provided, byway of summing unit, 
with input signals from the craft flight simulator defining craft attitude and with input signals from the said 
sensing means defining the viewer's head attitude. 

35 4. Head-coupled, area-of-interest, visual display apparatus as claimed in Claim 3, wherein the 35 
computer-generated image generating means is of a form subject to perceptible delay in computing said 
simulated image upon change of viewer's instantaneous line of view from a first line of view to a new line of 
view, including throughput delay error compensation means which is supplied with an input signal from the 
viewer's head and helmet orientation sensing means and is operative to compensate the line scan control 

40 and the frame scan control so as to project the scanned image upon the screen In said first line of view for the 40 
period of said delay. 

5. Head-coupled, area-of-interest visual display apparatus as claimed in Claim 1, in which the 
retro-reflective screen has a reflective characteristic such that it reflects a lesser proportion of light along the 
line of incidence from the frame scanning means to the screen and a greater proportion of light along the 

45 viewer's line of view from the screen to the viewer's eyes. 45 

6. Head-coupled, area-of-interest, visual display apparatus as claimed in Claim 1 , constructed substan- 
tially as described herein with reference to Figure 1 of the accompanying drawings. 
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